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THETA LIFTING OF NILPOTENT ORBITS FOR SYMMETRIC PAIRS 

KYO NISHIYAMA, HIROYUKI OCHIAI, AND CHEN-BO ZHU 

Abstract. We consider a reductive dual pair (G, G') in the stable range with G' the 
smaller member and of Hermitian symmetric type. We study the theta lifting of nilpotent 
ifp-orbits, where K' is a maximal compact subgroup of G' and we describe the precise 
i^C-module structure of the regular function ring of the closure of the lifted nilpotent orbit 
of the symmetric pair (G, if). As an application, we prove sphericality and normality 
of the closure of certain nilpotent i^c-orbits obtained in this way. We also give integral 
formulas for their degrees. 
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Introduction 

Let (G,G') be a reductive dual pair in a symplectic group G = Sp(2N, R), where iV 
denotes the rank of G. Throughout this paper, we will assume that (G, G') is of type 
I, and it is in the stable range with G' the smaller member (cf. E])- We will also 
assume that G'/K' is an irreducible Hermitian symmetric space. By the classification of 
irreducible dual pairs, our restriction amounts to saying that (G, G') is in the following 

list (cf. mi)- 

Table 1. The dual pairs treated in this paper 
the pair (G, G') stable range condition 

(0(p, q), Sp(2n, R)) 2n < min(p, q) 
(U(p,q),U(m,n))) m + n < min(p, q) 
(Sp(p, q), 0*{2n)) n < min(p, q) 

Note that we have excluded the equality 2n = min(p, q) in the first case, to avoid some 
small technicalities. 

Let g (resp. gf) be the complexification of the Lie algebra of G (resp. G') and K (resp. 
K') a maximal compact subgroup of G (resp. G ! ). Let 

g = 6©s, fl ' = r©s', 

be respectively Cartan decompositions of g and g', compatible in certain way (see 

Notation. Let G be a reductive algebraic group acting on an affine variety X. Then we 
denote the ring of G- invariants on the coordinate ring by C[X] G , and the affine quotient 
of X by G is defined to be X//G = SpecC[X] G , which parameterizes closed orbits in X. 
The affine variety X//G is often called a categorical quotient. 

Let PVr ~ R 2JV be a real symplectic space which realizes G = Sp(2N, R) as a symplectic 
group on Wm,. There is a canonical complex structure on W®. and we can view Wr as (the 
underlying real vector space of) a complex vector space W ~ C . The symplectic form on 
Wm. is then given by the imaginary part of a canonical positive definite Hermitian form on 
W. By this identification, a maximal compact subgroup K of G is realized as the unitary 
group U(W) ~ U(N) on W ~ C*. 

We may choose maximal compact subgroups K and K' of G and G' respectively, in such 
a way that K • K' is contained in the standard maximal compact subgroup K ~ U (N) of 
G. 

There is a double fibration of W by the moment maps if and if) : 
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For explicit realization of these maps, see the Appendix. Here we only mention some of the 
important properties of ip and ip. Thanks to the stable range condition, ip is a surjective, 
affine quotient map by the action of Kc- Thus we have s' ~ W//Kc- Furthermore 
ip : W — > $' is flat. On the other hand, the image of <p is an irreducible closed subvariety 
of 5 and ip : W — > (f(W) C s is also an affine quotient map by K' c . 

Theorem A (Theorem 12. 5|) . Take a nilpotent K' c -orbit O' C M{s'). Then the scheme 
theoretic fiber ip~ l (<0') = W x s / O' is a reduced, closed irreducible affine subvariety ofW. 
Moreover, it is the closure of a single Kc x K' c -orbit in W . 

The above result easily implies that the set <£>('0 -1 (Q')) is the closure of a single nilpotent 
A'c-oribt O in s. Thus we have a mapping from the set of nilpotent -fT^-orbits in s' to 
the set of nilpotent ii'c-orbits in s, which sends O' to O. We call this mapping the theta 
lifting and denote it by O = 6(0'). In the language of the signed Young diagrams, O is 
obtained from O' by adding one extra box to each row at the right end (see Proposition 
EH2J- Thus O is slightly "bigger" than O'. 

We remark that T. Ohta has proved the irreducibility and the existence of an open dense 
orbit by a totally different (but case-by-case) method ([211, Another recent work by 

Daszkiewicz, Kraskiewicz and Przebinda [U] proves similar results by classifying Kc x K' c - 
orbit in W combinatorially. There have also been earlier investigations of correspondence 
of complex nilpotent orbits in [5 and by S.-Y. Pan for complex as well as real nilpotent 
orbits. 

Our approach is in some sense intrinsic and it is based on methods of algebraic geometry. 
More importantly, we hope that it will help to shed light on the geometric aspects of the 
theta correspondence. The recent work of two of the authors [221 [2B] are efforts in this 
direction. 

Let C[0] (resp. C[0']) be the regular function ring on the closure of O (resp. O'). We 
are interested in the .ffc-module structure of C[OJ. One reason for this interest comes from 
Vogan's philosophy of unipotent representations [30 . Very roughly speaking, it entails 
that if a unitary representation tc is to be "associated" to a nilpotent orbit O, the regular 
function ring C[0] should encode the i^-structure of the representation tt. In the present 
situation, we will show that the i^c- m odule structure of C[0] can be described entirely and 
explicitly by the regular function ring C[0'] and the space of i^c-harmonic polynomials 
7i(Kc) on W. The main results are summarized in Theorem I2.1U1 In particular we have 
the following 

Theorem B. We have a K^-module isomorphism 

C[0] ~ (H(K C ) ®C[W}) K c. 

It is well-known [TO] that 7i(Kc) is multiplicity-free as a representation of Kc x K' c 
and the decomposition of H(Kc) I K K , determines a one-to-one correspondence between 

irreducible representations of Kc and K' c occurring in TC(Kc)- We note that the form of 
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isomorphism C[0] ~ (Ti.(Kc)®C[0']) K ' : bears strong resemblance to theta correspondence 
of admissible representations of G' and G [llj. 

In §21 we will give some examples of the lifted orbits and their regular function rings. 
We obtain a family of spherical nilpotent orbits and a precise i^c _m °dule structure of 
C[0]. We note that they occupy a large portion of the set of all the spherical nilpotent 
i^c-orbits, which are classified by D. R. King jTHj recently. As an application we prove 
normality of the closure of some of these nilpotent orbits, which are lifted from the smaller 
group. We also give explicit integral formulas of their degrees. The result is summarized in 
Proposition 13.51 The formulas involve certain integral expression, which can be explicitly 
evaluated. 

Theorem C. Let k be a complex number with a positive real part. Then 

1 f -A- o™^- 1 )/ 2 U n l ?> T(k + 2?) 

1/ D n tf)D n (x) Uxr'dx = * , %^ {K I" I 
n\ J Qn T(3n(n - l)/2 + nn + 1) 

where D n (x) = IlKkjXnl 1 ' - ^)' D n (x 2 ) = ni<i<j<n( x ; ~ x ))> and tfie region of integral 
is given as Q n = {x = (xi)i<i< n | Xi > 0, Yh=i Xi<l}- 

In the Appendix, we describe the explicit form of moment maps and give some basic 
properties of null cones. The results in the Appendix are known to the experts, but we 
include them because of lack of appropriate references. 



1. Diamond pairs 

We review certain structure results related to our dual pairs [TTj . 

Let Wr ~ M. 2N be a real symplectic space which realizes G = Sp(2N, M.) as a symplectic 
group on Wr. There is a canonical complex structure on W R and we can view as (the 
underlying real vector space of) a complex vector space W ~ C^. The symplectic form on 
is then given by the imaginary part of a canonical positive definite Hermitian form on 
W. By this identification, a maximal compact subgroup K of G is realized as the unitary 
group U(W) ~ U(N) on W ~ C^. 

We may choose maximal compact subgroups K and K' of G and G' respectively, in such 
a way that K • K' is contained in the standard maximal compact subgroup K ~ U (N) of 
G. 

In view of Table [TJ we sometimes write G = G(p, q) for 0(p, q), U(p, q) or Sp(p, q). We 
denote simply G{k) = G(k,0), which is compact. 

From the pair (G, G') , we define another three dual pairs, which form so-called diamond 
dual pairs (see [TTJ §5]). Namely, take the commutant of K in G and denote it by M' . 
Then M' is also of Hermitian symmetric type and isomorphic to G' x G' containing G' 
as the diagonal. The pair (K, M') is a dual pair of compact type. Also, take the full 
commutant of K in K, and denote it by L' . Then L' is a maximal compact subgroup of 
M', and it is isomorphic to K' x K' and contains K' as a diagonal subgroup. Similarly, 
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define M as the commutant of K' in G, and L the commutant in K. Let us summarize this 
somewhat complicated situation by the following diagram (Fig.[lJ). An explicit description 



Figure 1. The diagram of a diamond pair. 




K = K+ x K~ < > M' = G' x G' 



of the diamond pairs for our three cases is given in [Tl] (5.3)]. In the table there, L (resp. 
L') in our notation is written as M^ 1 ' 1 ' (resp. M'^ 1 ' 1 '). For convenience of readers, we 
reproduce the table here (Table El below) with some additional remarks. 

Table 2. Three diamond dual pairs. 



(G, G') M K = K + x K~ L = L+ xL~ K' 

{0(p,q),Sp(2n,R)) U(p,q) 0(p)xO(q) U(p)xU(q) U(n) 

(U(p,q),U(m,n))) U(p,q)xU(p,q) U(p)xU(q) (U(p)xU(p))x(U(q)xU(q)) U(m)xU(n) 
{Sp(p,q),0*(2n)) U(2p,2q) Sp(p)xSp(q) U(2p)xU(2q) U(n) 

M' = G' x G', L' = K' x K' 

Note that M/L is a Hermitian symmetric space (not necessarily irreducible), and the 
containment M D G (resp. L D K) may or may not be the diagonal map, but it is always 
a symmetric pair. 

Recall G = Sp(Wu) and the complex vector space W ~ which is identical to Wr as 
a real vector space. Then there exists a direct sum decomposition Wr = © and 
correspondingly W = W + ®W~ , which are compatible with direct product decompositions 
L = L + x L~ and K = K + x K~ in the following way. The subgroups L ± and K ± are 
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contained in the unitary group U(W ± ). Moreover the pairs (A^G 7 ) and (L ,K') are 
dual pairs in Sp(W£). Also note that L± D K± is a symmetric pair. 
For explicit realization of these decompositions, see the Appendix. 

2. Theta lift of a nilpotent orbit 

Let (55 = Lie (G)c (resp. & = Lie (K)c) be the complexified Lie algebra of G = 
Sp(2N, R) (resp. K = U(N)). Let (25 = .£©^3 be the corresponding (complexified) Cartan 
decomposition. Note that the complexified Lie group Kc acts on the Cartan space by 
the restriction of the adjoint action; under this action *}3 breaks up into ^3±, each of which 
can be identified with a copy of the space SyniAr(C) of complex symmetric matrices of 
size N. The action of k G GL(N, C) ~ K c on = <p + © ~ Sym at (C) © Sym N (C) is 
given by 

k-(X,Y) = (kX t k, t k- 1 Yk- 1 ) (A, Y G Sym jv(C)). 

Let O m i n C <p + be the minimal nilpotent Kc — GL(N,C) orbit in *}3 + . We have the 
identification O m i n = {(A, 0) | A G Sym n (C), rank A = 1}. It is also well-known that 
there is a map 



j: W — > O min 

ID LU iu = (tuj,...,^) £C ff - W 

w i — ► ( '«)«;, 0) 



by which O m i n = G m i n U {0} is regarded as a geometric quotient of the space W by the 
action of 0(1, C) = {±1}, and that the quotient map is Kc-equi variant. 

Let us consider the dual pair (G, G') C G. The maximal compact subgroup K (resp. K') 
determines a Cartan decomposition of the complexified Lie algebra q (resp. q') of G 
(resp. G'): 

= e©s, ' = r©s', 

where t (resp. 6') is the complexified Lie algebra of K (resp. A 7 ), and s (resp. s') is the 
orthogonal complement of 6 (resp. 6') with respect to the Killing form. The subspace 
s (resp. s') carries a linear action of Kq (resp. K' c ) via the restriction of the adjoint 
representation. Since G'/K' is a Hermitian symmetric space by assumption, s' breaks up 
into irreducible pieces s'± under the action of K' c . 

We can arrange the Cartan decompositions so that s © s' is contained in Then the 
inclusion map s C ^3 (resp. s' C $P) induces the projection — ► s* (resp. ^3* — > s'*). By 
identifying the complex linear dual ^3* (resp. s*, s'*) with ^3 (resp. s, s') by the invariant 
trace form of matrices, we obtain two projection maps P s : ^3 — >• s and P $ > : ^3 — > s'. The 
projections restricted to O min will then induce the so-called moment maps (cf. [21]): 

geom. quotient 

ttt- b y {±1} projection 

if i W ► O m in ► S 

: W > O min ► s' 
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These maps are Kc x i^-equivariant with the trivial i^c-action on s', and the trivial 
.fT^-action on s respectively. Also we can (and we will) choose the subspaces s'± C s' and 
W ± C W so that ^(W*) C s'± holds (cf. SUfor the notation W*). 

For a set 5 C *p, we denote by Af(S) the subset of all nilpotent elements in 5. 

Lemma 2.1. We can choose Cartan decompositions and moment maps so that the fol- 
lowing conditions hold. 

(1) ip is an affine quotient map by Kc onto s' , i.e., s' ~ W//Kc- 

(2) if is an affine quotient map by K' c onto its closed image. 

(3) ^- 1 (A^( 5 ')))CAT( 5 ). 

Remark 2.2. For part (1) to hold true, we only need to have the following conditions: 
min(p, q) > n for (0(p, q), Sp(2n, M)), min(p, q) > min(m, n) for (U(p,q),U(m,n)), and 
min(p, q) > ~ for (Sp(p, q), 0*(2n)). They are much weaker than the stable range condi- 
tion. 

Proof. To show that ip : W —>■ s' is an affine quotient map, it suffices to show that ip 
induces an algebra isomorphism C[s'] ~ CJW]^, where C[W] c denotes the space of 
invariants of the polynomial ring C[W]. Clearly it suffices to show that the restrictions 
^\ w ± induce algebra isomorphisms C[s'±] ~ C[W /± ] ii "c . 

Similarly, statement (2) asserts that the induced algebra homomorphism ip* : C[s] — > 
C[W] maps C[s] onto the K' c - invariants C^W]*^. Note that the closed subvariety Im^ C s 
is then defined by the ideal of relations of generators of invariants, or in other words, the 
kernel of ip*. 

Explicit constructions of moment maps for each case of the three dual pairs in Table Q 
are summarized in the Appendix. From the explicit formulas given there, the statements 
(1) - (3) follow easily from classical invariant theory [3T]. □ 

Using the moment maps, we shall define the theta lift of nilpotent orbits from J\f(s') to 
A/"(s). Before that, we review the following well-known result due to Kostant. 
We consider the null cones 

m = ip- 1 (0)cW, = (V^r^O) C W ± , (2.1) 

where if) : — > s'± is the restriction of if) to W ± . Let J C C^ 1 * 1 ] be the augmentation 

K ± 

ideal generated by homogeneous invariants C[W ] + c of positive degree, and let J = 
C[W}* C ■ C[W] = 

We observe that the stable range condition implies that 

is the ideal in CfW 1 * 1 ] vanishing on r t ± and is prime; 

The single i\^r-orbit of generic elements of is dense in < Jl ± . 

See for example Proposition 3.7.3.7, and Theorem 3.8.6.4 in [12]; and references therein. 
Some relevant properties of the null cones may also be found in the Appendix. 
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As usual, we denote by Ti(K c ) the space of harmonic polynomials on W ± (under 
the action of K c ). Similar notations apply throughout this article. Applying Kostant's 
criterion [T7j, we get 

Theorem 2.3. Let (G, G') be in the stable range {see TableQ) with G' the smaller member, 
and consider the dual pairs (K ± ,G') in Sp(W^r). Then with respect to the action of K^, 
we have a tensor product decomposition o/C[W /± ]: 

Corollary 2.4. We have 

C[W] ~ H(K C ) ® C\W] Kc ~ H(K C ) ® C[s']. 
Consequently the moment map ip : W — > s' is flat. 

Proof. Note that the induced map ip* of the moment map ip is just an inclusion: tp* : 
C[s') ~ C[jyp c <-> C[W]. Since C[W] ~ H(K C ) ® C[s'], it is free over C[s']. This implies 
that ^ is flat. □ 

We are now in a position to prove 

Theorem 2.5. Take a nilpotent K' c -orbit O' C J\f(s'). Then the scheme theoretic fiber 
^ _1 (0') = W x s i O' a reduced, closed irreducible affine subvariety ofW. Moreover, it 
is the closure of a single Kc x K' c -orbit in W . 

Proof. Let us prove that the fiber W x s / O' is reduced. For this, it is enough to show that 
the fiber of each closed point in s' is reduced. Namely, we prove the following lemma. 

Lemma 2.6. Let x G s' be a closed point. Then the scheme theoretic fiber ip' 1 ^) = 
W Kg/ {x} is a closed, reduced and irreducible affine subvariety ofW. Moreover, it is the 
closure of a single Kc-orbit. 

Proof. The scheme theoretic fiber is defined by W x s i {x} = Spec (C[W] <8>c[s'] d) • Here 
C x = C[s']/m x ~ C, where m x denotes the maximal ideal corresponding to the closed 
point x. Put A x = C[W] <8>c[s'] We are to show that A x is an integral domain. 
The proof is based on the general argument about deformations of homogeneous integral 
domains. 

Let us recall the tensor product decomposition C[W] = H(K C ) <%> C[s']. Thus, if we 
abbreviate Ti = TC(K C ), we can identify 

A x = C[W] <8> CM C X = H®C X ~H. 

However, note that TC is not an algebra but it only enjoys a structure of Kc x i^^-module. 
Since 7i is a graded subspace of C[W], it is naturally graded by the ordinary degree of 
polynomials. We denote the grading by Ti ~ ©fc>o^ fc - Then, A x becomes a filtered 
algebra by putting 

{A x )i = V n k ® i c n ® c x = a x . 

< ' k<i 
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Now assume that A x is not an integral domain. Then there are non-zero elements 
a, b £ A x such that a ■ b = 0. Let us express a and b as 

a = J2t =0 o< ® 1 e W <g> C x ; b = J2jL bj®leH® C x , 

with flj / and bd> ^ 0. Then ab = implies (a^') <8> 1 £ (A x )d+d'-i, but this 
is impossible. To see it, observe that the null cone 9t = 9T + x 9t~ is defined by the 
augmentation ideal J which is prime, and so 9t is irreducible. Note that C[9t] = C[W]/ J — 
TC. Since a^bd' TC by the irreducibility of the null cone, we have 

ad ■ b d > <E> 1 £" ]Cfc=o ~ 1 Ti k ®£ x = (A x ) d +d'-i, 
which is a contradiction. 

Next, we prove that the fiber ip' 1 (x) contains an open dense Hfc-orbit. Put M = ip~ 1 (x) 
and denote by M the asymptotic cone of M (see §5.2] for the definition of asymptotic 
cone). Then, by the flatness of ip, the asymptotic cone M coincides with the null cone 9T. 
Let O be a generic i^c-° r bit in M. Consider the cone CM generated by M in W, then 
it is clear that the dimension of a generic orbit in CM is equal to dim O, which in turn 
coincides with the dimension of the generic orbit in CM C W. Since 9T = M C CM, 
the dimension of a generic orbit in 01 cannot exceed that of O. Note that Ot has an 
open dense orbit (see the Appendix for details). This means that dim O > dimOT. On 
the other hand, we have an equality dimM = dimM = dimOt of dimensions, hence 
dim O > dim M. Since O C M, we conclude that dim O = dim M, and that O is an open 
dense orbit in M, by the irreducibility of M just proved above. □ 

Let us return to the proof of Theorem 12.51 

By i^-equivariancy of ip, we get V ;_1 (C) / ) = K^-ip~ 1 ({x}) for any x £ O'. Consider the 
multiplication map K' c x ip~ l ({x}) — * ■?/' _1 (0 / ). Since K' c x -?/> _1 ({a;}) is irreducible by the 
above lemma, V ;_1 (C) / ) is also irreducible (as an image of an irreducible set). Therefore its 
closure ?/> -1 (0') is irreducible. Since the moment map ip is flat by Corollary 12 A\ it is an 
open map (0 Ex. (III.9.1)]). Thus we conclude that ^(Q 7 ) = ^- 1 (0') is irreducible. 

By the same lemma, ?/'" 1 (x) contains an open dense i^c _or bit O x . Then the union of 
^-translates K' c ■ O x is dense in ^ _1 (0'). Thus K' c ■ O x = ^(O') = ^(W), which 
means that K' c ■ O x is open in ?/' _1 (0 / ). □ 

Remark 2.7. As mentioned in the Introduction, T. Ohta proved the irreducibility and the 
existence of an open dense orbit by a totally different (but case- by-case) method (|24|, 
j2Sj). In fact, his method is applicable beyond the stable range. However, outside the 
stable range, things get much more complicated and the same statement of the above 
theorem is no longer true. 

From the above theorem, we see that V9(^ _1 (0')) is a fCc-stable irreducible closed set 
in s. Since ip(ijj~ l (0')) is contained in the nilpotent variety A/"(s), which has only finite 
number of i^c-orbits, it must be the closure of a single Kc-orbit O. 
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Definition 2.8. Let O' C s' be a nilpotent -K^-orbit. Then ip~ l (<0') is a closed, irreducible 
affine subvariety in W. The image ip(ijj~ l (0')) is the closure of a single nilpotent i^c-orbit 
in s, i.e., ^(ip -1 {O')) = O for a certain nilpotent Xc-orbit O. We call O the theta lift of 
O', and denote it by 



We introduce some notations. For any complex reductive Lie group E, let Itt(E) be 
the set of equivalence classes of irreducible finite dimensional representations of E. Given 
a (completely reducible) representation of E on U, let Itt(E;U) be the subset of Irr(E') 
which appear in U. 

We now recall some standard results of Howe ^U]- As noted in the Introduction, the 
space of harmonics TC(K^) is multiplicity-free as a representation of x K' c . Further- 
more the decomposition 

H(Ki)\r+ „, ~ V® ctKt (2.2) 

determines a one-to-one correspondence between a G Irr(.?Qjr; 7i + ) and r G 1ty(K' c ; T~C + ), 
where we abbreviate TC(K^) to 7i + . Similar statements apply to H(K^). 

We shall abbreviate R ± (K' C ) = Itt(K' c ; TC(K^)) in the following. Under the assumption 
of stable range, one can explicitly check that r* G R + (K' C ) if and only if r € R~(K^), 
where r* denotes the contragredient representation of r G Iyt(K'). So we put 

R(K' c ) = R + (K' c y = R-(K' c ). (2.3) 

To summarize, for each r G R ± (K' C ), there exists a unique a G Irr(iT c ) such that 

We denote this a by ct ± (t), specifying the dependency of r and the sign ±. Then, we can 
rewrite ()2.2|) and its sister statement as 

H(K+) ~ ^ ff + (r*)Kr*, and H(K^) ~ ^®ct-(t)Kt. (2.4) 

Remark 2.9. By the theory of highest weight, we may identify R(K^) with a certain 
semigroup in the integral weight lattice of K' c . We note that in an explicit realization, 
the semigroup R(K' C ) may be identified with a set of partitions, and it is saturated. The 
explicit decompositions in Equation (|2.4j) are well-known. See jT^j for the orthogonal and 
unitary cases, or |X2J in general. 

Theorem 2.10. Let (G,G') be in the stable range {see Tabled with G' the smaller 
member. For a nilpotent K' c -orbit O' C J\f(s'), denote its theta lift by O = 9{0'). Put 
H(O') = ip~ l (0'). Then the closure O is an affine quotient o/H(Q') by K' c . 

0^~(Q')//K' c . 
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Moreover, the K^-module structure of the regular function ring of O is given in terms of 
O' as follows: 

C[0] ~ (H(K C ) ®C[W}) Ki 

~ Hom^^^^CpD^^^Bd-^)), (2.5) 

ti,t 2 £R(K' c ) 

where cr + (r*)Kl(T~(T2) is an irreducible representation of Kc = K^xK^ given in Equation 
()2.4|) . and K c acts on the space of multiplicities Hom^(r! <£> r|,C[0']) trivially. 

Proof. The assertion that O is an affine quotient follows from general theory of affine 
quotient maps because <p itself is a quotient map, and S(O') is a ^-invariant, affine 
closed subvariety of W (cf. (201 Prop. 3.3]). 

Next we prove the statement on the module structure of C[Oj. By Theorem 12.51 we 
have 



C[H(Q')] ^ C[W x s > O'] = C[W] ®cm 

~ {C[W + } ® C[W-]) ®cw + ]®c[s'-] C P1 

~ (C[W+] ® cw+] Cp 7 ]) ® C[W] (C[W-} ® CK] Cp 7 ]) . (2.6) 

Note that C^] ~ H(^)®C[W A± ] x c and CpM^]-^ ~ C[s' ± ] by TheoremlP Therefore 
we have 

C[W + ] ® cw+] Cp 7 ] ~ ® C[iy + ]^ + ) ® c[s y Cp 7 ] ~ § 

and ()2.6|) becomes 

(H(K+) ® Cp 7 ]) ® C[W] (H(Kc) ® Cp 7 ]) ~ (W(JtJ) ® )) ® 
Since y> is an affine quotient map by the action of K' c , we have 

Cp] ~ C[~(G>')] A ^ ^ ®H(K^)) ®Cp 7 ])^ 

- XT (( (T+ ( r i) K r ® O 7 "^) K r 2) ® Cp 7 ])^ 

ti,t 2 &R(K' c ) 

- YT ( r * ® T2 ® C Pl)^ ® KOf) B <r-(r 2 )) 

~ ^® Hom^r^r^Cp 7 ])® (<7 + (t?) B <t-(t 2 )). 

ri,r 2 efi(^) 

The theorem follows. □ 
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Let us briefly describe our orbit correspondence in terms of signed Young diagrams. 



Since our G or G' is either Sp(2n,M.),0(p,q),U(m,n), Sp(p,q) or 0*(2n), their nilpo- 
tent Kc-orbits are classified by the signed Young diagrams. See, e.g., [U §9.3] for the 
classification in the case of classical Lie algebras. We reproduce it for the readers' conve- 
nience. 

Lemma 2.11. The nilpotent K^-orbits for a symmetric pair (G,K) are in one-to-one 
correspondence with the following signed Young diagrams. 

(1) G — Sp(2n, M) : diagrams of size 2n with any signature in which odd rows begin with 
+ and occur with even multiplicity. 

(2) G = 0(p,q) : diagrams of size p + q with signature (p,q) in which even rows begin 
with + and occur with even multiplicity. 

(3) G = U(m, n) : diagrams of size m + n with signature (m, n). 

(4) G = 0*{2n) : diagrams of size n with any signature in which odd rows begin with +. 

(5) G = Sp(p, q) : diagrams of size p + q with signature (p, q) in which even rows begin 
with +. 

Proposition 2.12. Let O' be a nilpotent K' c -orbit inj\f(s'), and O = 0(Q') its theta lift. 
If O' corresponds to a signed Young diagram X' , O corresponds to X which is obtained by 
adding one box to the right end of each row (including empty one) of X' . The signature 
of the added boxes are completely determined by the requirement that X is a signed Young 
diagram for (G, K). 

Proof. We note that the stable range condition ensures that we can always make A out 
of A' by adding a box in each row. Then the proof is based on a case-by-case calcula- 
tion, using explicit realization of moment maps in the Appendix. Since we know that 
<^(^" 1 (0')) = O, we only need to take a representative of O' and examine a generic 



We apply Theorem 12.101 to the lifting of the so-called holomorphic nilpotent orbits. 
In the process, we get a family of spherical orbits and prove normality of the closure of 
certain lifted orbits. This application reproduces some of our previous results ([TH], |2Tlj . 
|22j) as well. In the following, we use the notations in Theorem 12. 101 freely. 

Let us consider the orbit decomposition of s' + by the adjoint action of K' c . Any Zf^-orbit 
in s' + is clearly nilpotent. We call these nilpotent orbits holomorphic. It is well known 
that s' + is a prehomogeneous vector space, and there exists a numbering of -fT^-orbits 
Oq, Oi, . . . , O; in such a way that O-^ C QJ for 1 < i < I. Here I is the real rank of G' . 
As a consequence, O' = {0} and = s' + , i.e., is the open dense orbit in s' + . The orbit 
Q[ is called regular, while the orbits {O' k }o<k<i are called singular. 



See also [21], E3, 0- 




□ 



3. Lifting of holomorphic nilpotent orbits 
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3.1. Trivial orbit. We first consider the trivial orbit O' 1 = O' = {0}. Then, the lifted 
orbit O 1 = ^(O' 1 ) is a two-step nilpotent orbit in A/"(s) (cf. [19j). The orbit O 1 corresponds 
to the following signed Young diagrams. 



0(p,q) 
U(p,q) 
Sp(p, q) 

We have 



a = {(+-) n (+y- n (-) q - n ] 



Theorem 3.1. The group Kc acts on O 1 multiplicity- freely. As a Kc = K^xK c -module, 
we have 

C[W] ~ J]® a + {r*) Mo--(t). (3.1) 

r&R{K' c ) 

Proof. Since C[0 /:l ] = C, by Theorem 12.101 we get 

But, by Schur's lemma, the multiplicity Hom^(ri ® r|,C) is not zero if and only if 
T\ = r 2 , in which case it is C, i.e., the multiplicity is one. □ 

Recall that an orbit O is called spherical, or more precisely Kc-spherical, if a Borel 
subgroup of Kc has a dense orbit in O. This is equivalent to saying that Kc acts on O 
multiplicity-freely (i.e., C[0] decomposes without multiplicity as a i^c-module). 

Corollary 3.2. The orbit O 1 lifted from the trivial orbit is spherical. The closure O 1 is 
a normal variety. 

Proof. The claim that O 1 is spherical follows directly from the above theorem. The 
normality follows from [2H1 Th. 10]. □ 

3.2. Regular holomorphic orbit. Let us denote by Of = 0(O[) the theta lift from the 
regular holomorphic orbit OJ C s' + . The orbit Of corresponds to the following signed 
Young diagram. 

0{p,q) : A = [(+-+) n (+) p - 2n (-) q - n ] 

U{p,q) : A = j(+-+) n (+-) m - n (+) p -( m+n )(-)^ m ] (m>n) 

[( + _ + )(n-l)/2( + _)( + ) P -n(_) g -(n+l)/2] (jl = 21 + 1) 
[( + _ + )n/2( + )p-n(_) ff -n/2] ( n = 2/ ) 

For the regular orbit, we have 

s(o;) = v _1 (oD = = w + x gr, 

where ip~ = ip\ w - and 91" = (^ _ ) _1 (0) C W~ is a null cone. Thus Theorem 12. 101 yields 
the following 



Sp(p, q) : A 
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Lemma 3.3. Let Of C Af(s) be the theta lift of the regular holomorphic orbit 0' lt which 
is open dense in s' + . Then its closure is an affine quotient ofW + x 9t~ by K' c , 

Of - (W + x m-)//K' c . 

Let us recall ( JQ) the compact group L + whose action on W + commutes with that of 
K' . In fact (L + ,K') forms a dual pair in Sp(W£). Let 

C[W + ] ~ JZ® p + (r)®r (3.2) 

reIrr(K£;C[W+]) 

be the decomposition of C[W + ] as an L + x K'- module. Here p + (r) G Irr(L + ) cor- 
responds to r G Irr(f^') via the above multiplicity-free decomposition. Note that 
C[W + ] ~ ®C[W+] K c, and so Irr(i^; C[W+]) = Itx{K' c ]H{K^)) = R{K' C )*. 

We may therefore rewrite Equation (|3.2|) as 

C[W+]~ ^%+(r*)®r*. (3.3) 

Note that L + is a unitary group containing K + in each of the three cases, hence its 
complexification is isomorphic to a general linear group. Since the action of 
commutes with that of K' c , x Kq naturally acts on the affine quotient space 

(w + xm-)//K' c ^of, 

extending the action of Kq = x fQT. Note that the orbit Of itself does not admit an 
action of x K^, but its closure does. 

Theorem 3.4. The group x K@ acts on the closure Of multiplicity- freely. As a 
x -module, we have 

C[Of}^ P + (rl®o--(r). (3.4) 

Consequently, the closure Of is x -spherical, and it is a normal variety. 
Proof. We have 

c[of] ~ (c\w + ] ®c[<yi-)) K ' c 

-(( J2 e p + ( T i)® T t) ® ( J2 e ^(^)®r 2 )) Xc 

neR(K' c ) r 2 aR(K' c ) 

t&R(K' c ) 

The normality follows from |2S1 Th. 10], since ZR(K' C ) n Q+R(K' C ) = R(K' C ). □ 
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3.3. Degree of nilpotent orbits lifted from holomorphic orbits. As an application 
of the explicit decomposition formula of the function ring of nilpotent orbits, we give an 
integral formula of their degrees. 

Since a nilpotent orbit O C s is a cone, we naturally consider it in a projective space 
P(s). As a projective variety, the closure P(O) in P(s) has a degree. We shall denote this 
degree by degO by a slight abuse of notation, and we call it the degree of the nilpotent 
orbit O. We refer to [2E1 §V.4.2] for the definition of the degree of projective varieties. 
See also jHj. 

To state our result, let us introduce some notation. We denote by A = A(X r ) an 
irreducible root system of type X r = A r _i, B r ,C r , D r . We realize A in a standard way 
(see (2, Planche I-IX]), and choose a positive system A + as A + (A r ^ 1 ) = {e^ — Ej | 1 < 
i < j < r}; A + (D r ) = { £i ± Sj | 1 < i < j < r}; A + (B r ) = A + (D r ) U { £i | 1 < i < r}; 
A+(CV) = A + (D r ) U {2ei | 1 < i < r}. As usual, p = p Xr = E aS A+ a / 2 denotes the 
half sum of positive roots, and we fix an invariant inner product (a, (3) on the root space 
which makes {ei} an orthonormal system. For fixed n < r, we put 

A+(X r ) = {a e A+(X r ) | (a,Ei) = (1 < i < n)}, and 
$+(X r ) = A + (X r )\A+(X r ), 

and for m + n < r, 

$+ >n (A-i) = {^i - Sj e A+(A r _x) \ i <m or r - n < ]}. 

We introduce the difference product D n (x) on a multi- variable x = (xi, . . . , x n ) defined 

by 

D n (x) = Yll<i<j<n( X i ~ X j)- 

We abbreviate D n (x 2 ) = D n (x1, . . . , x^). Finally set 

tt n = {X = {Xi)i<i< n | Xi > 0, YTi=i x i < !}■ 

Proposition 3.5. (1) Case 0(p, q) x Sp(2n, M.) (2n<p,q): Put r = [p/2],s= [q/2] and 
X = B or D (respectively Y = B or D) according as p (respectively q) is odd or even. 
Then the degree of the nilpotent orbit is given by 

i r n 

deg oi = - n (px^a)- 1 n (PYs^y 1 lA^n^ 9 " 2 ^ 

n -a^+(x r ) 0e^+(Y s ) Jn n i=i 

1 f n 

degOf = - n (Px^a)- 1 n (PA^P)- 1 \D n (x 2 )D n (x)\Yl x r q ~ 3n dx 
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(2) Case U(p, q) x U (to, n) (to + n < p, q) : 

x / \D n {x)\*\D n {y)\* II (^ + y,) 2 n^ +<? " 2(m+n) flv^^dxdy 

J l<i<m i=l j=l 

n m XaZn l<Cj'<C?Z 

deg ®?=i n H-n^)- 1 n (PA,-!,®- 1 n k^t)- 1 

m - n - «e$+,„(VO /3e$£(A,-i) 7e*,t(A 9 _i) 



x 



p+g— (2m+n) -r-r p+q— (m+2n) 
J 

l<i<m «=1 jr'=l 

n m xfi„ i<?<n 



|D m (a;)| 5, |2? B (y)| a EI (*i + n z^" 1 n 



(3) Case Sp(p, q) x 0*(2n) (n < p, q): 



2 



2;i 



n 



degOi = — n (Pc P ,«)^ n (Pc^P)- 1 \D n (x 2 )\ 2 U^ P+q) -' n+2 dx 
n - ae*+(c p ) /3e*i(c 9 ) J n n »=i 

on 

deg0 f = - n (pc,,^- 1 n (pa^,^)- 1 

n -«e<i'+(C p ) /3e*+(A 2? -i) 



Proof. Since we know the i^c-decomposition of the regular function ring, we can formally 
express the Poincare series by using Weyl's dimension formula. The degree e is encoded in 
the top term of the Hilbert polynomial i%(i), whose degree coincides with d = dimP(O). 
Thus, we have e = d\ lim^oo f%(t)/t d , which is essentially expressed by a Riemann inte- 
gral (the limit of a Riemann sum). This machinery is explained in [Tol §2.2]. We omit 
the details. □ 

Let us evaluate the following integral, which appears in the above proposition. 

Theorem 3.6. Let k be a complex number with a positive real part. Then 

1 r -A- 2 n(n " 1)/2 FT™" 1 z> T(k + 2i) 

-i / D n (x 2 )DJx) FT xr'dx = — . Ui =° l -^ K + Z% > (3.5) 
n\J Un nK } nK) f = \ 1 r(3n(n-l)/2 + n« + l) 1 J 

Proof. First we set 

/(*) = /(x, «) = L> n (x 2 )^ n (x) nr=i 

Let a = 3n(n — l)/2 + we, then /(x) is homogeneous of degree a — n, that is, 

/(Ax) = A a ~"/(x) (A > 0). 
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We consider the integral 

r(a + l) / f(x)dx = I f(x)s a e- s dxds. 

Jfl n Jq„x(0,oo) 

We have a diffeomorphism 

Q n x (0, oo) 9 (x, s) h-> (y, £) G (0, oo) n x (0, oo), 

given by 



Xi = !/»/(* + £fc=iSte)» \Vi = sxi, 



The Jacobian of this map is given by 

<9(x, s) 
Then 

f(x)s a e~ s dxds = f{sx)s n e~ s dxds = f{y)e~ t ~^= lVi dydt. 

This proves 



r(a + l) / /(x)tfa; = / f(x)s a e- 8 dxds = [ f(y)e-^ Vi e- t dydt 

Jn n Jn n x(o,oo) 7(0,00)™+! 

= / f(y)e-^ividy (3.6) 

•/(Coo)™ 



'f2„x(0,oo) 7 (0,oo ) 

/ 

'(0,oo 

Now we use the determinantal expression 



D n (y 2 ) = n (j/Nyi) = det(y J - ( ^ 1 W.. > n=E«P 1 ( <7 )IIy- 



n 

2(«T(i)-l) 



= (j/i - j/j) = det(j/j 1 )<j=i „ = sgn ( r ) n 

!<*<i<" tG5„ i=l 



n 

r(i)-l 



i,j=l,...,n 
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Then (IH.fjjl becomes 

f n /*oo 

/ f(y)e~^^dy = J2^Hn(r)H / yf^- 1 ^' 1 ^ 1 e^d Vi 

./(0,oo)» CT)T i=1 ^0 

= E CT , T sgn(<r) sgn(r) T(2a(z) + r(i) + « - 3) 
= n! E CT sgn(a) n"=i r(&r(i) + z + « - 3) 
= n\ det(r(2i + j + k - 3)) iJ=:l) ... in 

= n! nr=o r ( K + 20 x det ((2z + « - 2) ; ; ) ; ; , n , 

where (c)& = c(c + 1) - • • (c + A; — 1). The last determinant is 

det ((2i + * - 2) i _ 1 ) y=w = det ((JM + « - 2)' l ) y , „ 

= vdM(K, k + 2, . . . , k + 2n - 2) = vdM(0, 2, . . . , 2n - 2) = 2 n{n ~ 1)/2 « ! 

Here vdM denotes the vandermonde determinant: 

vdM(ci, . . . , Cn) = rTl<i<i<n( C i - C i)- 

This gives 

1 r i n_1 

- / f(x)dx = —, ___2 n ( n ~ 1 )/ 2 J] i! r(« + 2,), 
n! y n „ T(a + 1) a± 

which is the formula ()3.5|) . □ 

Remark 3.7. By a similar argument, we have 

-J D n (xrf[xr 1 dx = — IE^±^xdet(( K + 2.-2) 2 ,_ 2 ) M=1 „ 
n! 7n n -M- 1 (2n(n — 1) + tik + 1) ' J ' ' 

The last determinant depends on k polynomially and seems to have no simple expression. 
This suggests that O 1 may have a more complicated structure than that of Of. 



4. Appendix 

In Appendix, we will give an explicit construction of moment maps <p and ip, and 
establish some basic properties of null cones and harmonics. 
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4.1. 0(p,q) x Sp(2n,M) (2n < min (p, q)). This case is already treated in ^H]- For 
convenience of the readers, we reproduce the synopsis of the arguments, and at the same 
time we improve some of statements there. 

Put G = 0(p, q) and G' = Sp(2n, R), and assume the stable range condition 2n < p, q. 
We denote: 



M = U(p,q) D G = 0(p,q) 

U U 

L=L+xL- D K=K + xK- 
= U(p) x U(q) = 0(p) x Q(q) 



M' = Sp{2n, R) 2 D G' = Sp{2n, ) 

u u 

L'= K' x K' D K' = U(n) 
= U(n) 2 



In this diagram, the vertical containment means respectively maximal compact sub- 
groups, and A denotes the diagonal embedding. Put 



W = M, 



p+q,n 



fj \AeM Ptn (C),BeM q>n (C)\ 



= W + © W~ = M PjU (C) © M q>n (C). 

The complexification Ac = 0(p, C) x 0(q, C) acts on W via the left multiplication, and 
K' c = GL n (C) acts on W as 



9 ■ 



Bg- 1 ' 



9 e GL n (C). 



We fix a Cartan decomposition g = 6 © s (resp. g' = t' © s') as 
g = o(p + q, C) = 



Altp(C) 








Alt,(C) 



g'=sp(2n, C) 



M n (C) 








-*M„(C) 



= tf © s') as 


( ° 


M M (C)\ 




J 





Sym n (C) N 


Sym„(C) 


, 



e©s, 



r © v. 



Thus, we can identify s = M Pj(? (C) and s' = s' + ©s'__ = Sym n (C)©Sym„(C). The moment 
maps are explicitly given by 



l AA, l BB) e s'. 



These maps are clearly Ac x ii'^-equivariant if we define the trivial Ac-action (resp. 
A c -action) on s' (resp. s). In the language of algebra, <p is induced by 



if {z, 



j) = a ^ b ^ Z = (^) G S ' (b) = ((&■'■)) G ^' 
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and it is well known that y>*(zjj)'s generate GL ra -invariants C^W]*^. This shows that 
ip : W — > s is an affine quotient map onto its closed image: s D <f(W) ~ W//K' c . 
Similarly, if) is induced by 

^*{ x i,j) = Y7k=l a k,i a k,j, X = (Xij) G s' + ; ip*(yi,j) = Y,Li Y = (Vi,j) E 

Again, ip(xij)*'s and ip(yij)*'s generate the 0(j>, C) x 0(g, C)-invariants CfVK]^ , which 
proves that ip : W — > s' is an affine quotient map. By the assumption of the stable range, 
2n < p, q, it is easy to see that if) : W — > s' is a surjection, hence s' ~ W// Re- 
Let us consider the null cones 

9t = ^-^o) c w, < n ± = (^ ± ) _1 (o) c w ± , 

where if) : — > s'± is the restriction of if) to W^ 1 * 1 . 
Proposition 4.1. Assume the stable range condition 2n < p,q. 

(1) The null cone 9t = 9t + x 91" an irreducible normal variety, which is of complete 
intersection in the set theoretic sense. 

(2) There are finitely many Rc x R' c -orbits in 9t ; which are completely classified by the 
ranks of each component in r T ± . Among them, there is an open dense Rc X R' c -orbit 
O nyU , which is a single R^-orbit. Moreover, the singular locus coincides with yi\O n ^ n , 
which is of codimension > 2. 

(3) The regular function ring C[9T] is isomorphic to the harmonics TC(Rc) — T~t + {Rc) ® 
7i~(Rc) as a Rc x R c -module. Its decomposition is explicitly given as 

C[9T+] ^ H+{R+) ~ ® C P*1 - - E e ® ^ B) . 

where V n denotes the set of all the partitions of length < n, and (resp. ) is an 
irreducible finite dimensional representation of GL n (resp. 0(p,C)) of highest weight A. 

Remark 4.2. (1) In [T^j, the orbit decomposition of the null cone is carried out for RcxL' c , 
though it is more natural to consider Rc x i^-orbits. In fact, their orbits are the same 
(under the assumption of stable range). Also, in the normality is proved when 
2n + 2 < p, q. Here we improve it, and there is no more restriction other than the stable 
range condition. 

(2) It is rather subtle to specify the representation o^' because 0(p, C) is not connected. 
For this, see P, §3.6.2]. 

Proof. It is straightforward to check the claim for the Rc x i^-orbit decomposition in 
(0) directly by calculation. Let us denote TjS = 0+ x 0~ G 91, where 

0+ = {A G M Pi „ | l AA = 0, rank A = r} C 9T+, 
0~ = {B G M 9 , n | *BB = 0, rankS = s} C 91". 
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Then 0+ is a K£ x i^-orbit, and O r ^ s is a single Kc x iT^-orbit. Since they are classified 
by rank, the orbit of the largest possible rank O n<n is open dense in 91. This implies that 
9t = O nin is irreducible. In fact, O n , n is a single i^c-orbit. This follows from the Witt 
theorem. 

Explicit calculation of the rank of differentials of the defining equations of ip*(xij) 7 s and 
ip*(yijys tells us that a point from 9t\0 n ,n is singular. Since 

t ™+ n(n+l) ,. „_ n(n + l) 
dim 9t = rap , dim 9t = , 



we have codim9t = n(n + l), which is equal to the number of the defining equations. This 
proves that 9t is of complete intersection. 

The dimension of the K£ x i^-orbit in 9t + of rank r is given by 

dim Oy = r{p + n) — r 2 . 



From this formula, we can easily show that codim (*Jl\O n>n ) > 2. 

By Kostant theorem (see [3J Th. 2.2.11], for example), we know that the defining 
radical ideal of 9t is generated by ip*(xijYs and ^>*(?/jj)'s, which are basic invariants of 
0(p, C) x 0(g, C). This means that 



cprt] = C[W]/(V*(^),V*(^)) = C[W]/C[W] ■ C[W]* C ~ H(K C ). 

The decomposition of TC(Kc) is given in O Th. 3.7.3.1 & Cor. 3.7.3.6]. See also jTj and 
|14j . By the same theorem of Kostant, the null cone 9t is normal. Also, Or 1 * 1 are normal 
varieties. □ 



4.2. U(p,q) x U(m,n) (m + n < min (p, q)). Put G = U(p,q) and G' = U(m,n), and 
assume the stable range condition m + n < p,q. We denote: 

M = U(p,q) 2 D G = U(p,q) 

U U 

L = L+ x Ir = U(p) 2 x U(q) 2 D K = K+ x K- = U{p) x U(q) 

Here A denotes the diagonal embedding. Similarly, we denote M', G', L f , K' replacing p 
and q by m and n respectively. Put 

W = M p+q>m+n (C) = I \A e M p , m , B e M p , n , C e M q , m , D e M 9 , n J 

= W + © W~ = M p , m+n (C) © M q , m+n (C). 
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Then K c = GL P (C) x GL q (C) and K' c = GL m (C) x GL n (C) act on W as 



((91,92), (hi,h 2 )) 



A B\_( gxA l h x tgi^Bhz 1 
CD) - \ t g 2 - l Ch- 1 l g.D'h 



(91,92) e GL P (C) x GL q (C), (h,h 2 ) e GL m (C) x GL n (C). 
We fix a Cartan decomposition $j = I © 5 as 



= WC) 



M P (C) 








M,(C) 






Af Pl5 (C) 


M W (C) 






£©s. 



The Cartan decomposition g' = £' © s' is chosen similarly. We identify 

5 = M p>q (C) © M Q;P (C), s' = M m>n (C) © M n , m (C). 
The moment maps </? and ■?/> are explicitly given by 

<p:W3^ 1 — > (A t C, D t B) E s, ^ : W 3 1 — > (*AB, t DC) E 5'. 

These maps are K c x i^-equivariant with the trivial K c -action on 5', and the trivial 
frc" ac ti° n 011 5 respectively. The maps tp and ip are almost the same. Therefore we will 
treat only the map ip in the following. 

The map tp induces an algebra homomorphism ip : C[s'] — > C[W] by 

V(xi,j) = ELi a kA,j ; = ELi C *,A*> 

where (xjj) and (yij) are coordinate function on (X, Y) e M m>n (C) x M njm (C) = s'. 
Then the GL p -invariants (resp. GL^-invariants) on C[W + ] (resp. C[W _ ]) are generated 
by ^(xjj)*'s (resp. ^(y^j)*^). Hence ^ : — > 5' is an afline quotient map by K c , which 
is surjective under the condition of the stable range. Note that (p is not surjective in 
general. 

Let us consider the null cones 

m = ^- 1 {o)cw, w k = (i/> ± )- 1 (o)cw ± , 

where ip^ : W ± — ► s'± is the restriction of ip to W ± . 

Proposition 4.3. Assume the stable range condition m + n < min(p, q). 

(1) The null cone = 9t + x 91" is an irreducible normal variety, which is of complete 
intersection in the set theoretic sense. 

(2) There are finitely many Kc x K' c -orbits in 9T ; which are completely classified by the 
ranks of each component in r t ± . Among them, there is an open dense Kc x K' c -orbit 
O m<n , which is a single K c -orbit. Moreover, the singular locus is of codimension > 2. 
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(3) The regular function ring C[9t] is isomorphic to the harmonics TC(Kc) — H + (K£) <8> 
7i~(K^) as a Kc x K' c -module. Its decomposition is explicitly given as 

C[91+] ~ ^ £ e r^*®^*®^), 

aev m ,pep n 

where, for partitions a G "P m and (3 &V n , we denote 

a®f3 = a®p(3 = (a 1: a 2 , ■ ■ ■ , a m , 0, . . . , 0, -ft n , -fa) G Z p ; 

and rj^ is an irreducible finite dimensional representation of GL p of highest weight A. 

Proof. Put 0+ s = {(A, B) G M Pim+n | l AB = 0, rank A = r, rank B = s} C Vt + . Then 
0+ s is a K£ x K^-orbit, and dim (9+, = r(m + p) + s(n + p) + rs — (r + s) 2 . It is easy to 
see that C 9I + is an open dense orbit and dim9I + = dimC+ n = p(m + n) — mn, 

which means is of complete intersection. The singular locus is given by 



r<m— l,s<n— 1 

which is of codimension > 2. The rest of the proof is similar to that of Proposition 14.11 
The decomposition of harmonics is given in ^21 Th. 2.5.4]. □ 

4.3. Sp(p,q) x 0*(2n) (n < min(p, q)). Put G = Sp(p,q) and G' = 0*(2n), and assume 
the stable range condition n < p,q. We denote: 

M = U(2p,2q) D G = Sp(p,q) M' = 0*(2n) 2 D G' = 0*(2n) 

u u u u 

L=L+xL- d if=iT + xr L'-K'xK' D if' - C/fn) 

= tf(2p) x 17(2,) = Sp(p) x ^ I iv — C/(n) 

Put 

W = M 2p+2g , n (C) = | m | A G M 2p , n (C), 5 G M 2 ,, n (C)} 

= W + ®W~ = M 2p , n (C) © M 2 ,, n (C). 

The complexified groups Kc = Sp(2p, C) x Sp(2q, C) and K' c = GL n (C) act on W as 

A\ / \ (k 1 ,k 2 )eSp(2p,C)xSp(2q,C) 

BJ ^ I ^Bg- 1 ) ' (7 G GL n (C) 
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We fix Cartan decompositions g = t © s and q' — t' © s' as 
fl = sp(2p + 2q, C) = 

= fi © s, J p = 



sp(2p, C) 








sp(2q, C) 






M 2 p,2q 


Jq t M2p J 2qJp 






-i P o 



S' = o(2n,C) 



M„(C) 








-*M„(C) 






Alt n (C) 


Alt n (C) 






tf © s'. 



Thus, we can identify 5 = M 2p: 2q(C) and s' = s' + ©s'_ = Alt „(C) © Alt „(C). The moment 
maps are explicitly given by 

V :W3 (J^J i— > A*5 G S, iJ:W3 (J^J i— > (*A/ p ,4, *5J,5) G 5'. 

These maps are clearly Ac x A^-equivariant with the trivial Ac-action on s', and the 
trivial A^-action on s respectively. They induce algebra morphisms tp* and ip*\ 



2~2k=l a i,kbj,k, Z — (Zij) G M 2 p : 2q, A — 

2~^lk=i Q , k+p,iQ'k,j © 2~^lk=i ®'k,iQ'k+p,j i A 



"1,3. 

■ (x 



G M 2p , n , B = (bij) G M 2 q, n , 



G Alt n , 



Classical invariant theory tells us that </?*(zjj)'s generate the GL n -invariants C^W]*^ and 
that ^(xijY's (resp. ■0(yi,j)*' s ) generate the A^ = Sp(2p, (C)-invariants CfVF+^c (resp. 
A c = Sp(2q, C)-invariants C[Vr~]^c ). This shows that cp and tp are affine quotient maps. 
By the assumption of the stable range, n < p,q, the map ip : W — > s' is a surjection, and 
we have C[s'] ~ C[W^ ? C[s' ± ] ~ C^J^c . 
Let us define the null cones by 

DT = -0 _1 (O) C W, ^ = (V' ± ) _1 (0) C W" ± , 

"- — > s' ± is the restriction of ^ to W^. 



where ip : 

Proposition 4.4. Assume the stable range condition n < p,q. 

(1) The null cone 9T = DT + x 9T~ «s an irreducible normal variety, which is of complete 
intersection in the set theoretical sense. 

(2) There are finitely many Ac x K' c -orbits in 91, which are completely classified by the 
ranks of each component in < Xt ± . The full rank orbit O n ,n is an open dense Ac x K' c -orbit 
in 9t, which is also a single K c -orbit. The singular locus o/Ol is of codimension > 2. 
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(3) The regular function ring C[9t] is isomorphic to the harmonics H,(Kc) ~ 7i + (K^ 
H~(K^) as a I\ ■ x K' c -module, and we have 



where denotes an irreducible finite dimensional representation of Sp(2p, C) with high- 
est weight X eV n . 

Proof. Put 

£>+ = {A G M 2p>n | l AJ p A = 0, rank A = r} C 9?+, 
£T = {Bg M 23 , n | *BJ,B = 0, rankS = s} C 9T. 
Then O r>s = 0+ x is a single ifc x -K^-orbit and 

dim C+ = r(2p + n) - r 2 - r ^ ~ 1 \ dim 0+ = s(2g + n) - s 2 M " ~ 1 ' 



2 ' s 2 

It is easy to show that Ot C 9I ± is an open dense orbit and 

TliTl — 1) TliTl — 1) 

dim 0t + = dim 0+ = 2pn K — — -, dim 9T = dim 0~ = 2qn K — — -, 

which tells us that 9t (resp. OT^) is of complete intersection. The singular locus is given 
by 

II otcm ± , 

r<n-2 

which is of codimension > 2. The rest of the proof is similar to that of Proposition 14.11 
The structure of harmonics is given in [T2*l Th. 3.8.6.2]. □ 
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